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Abstract 



' Wc consider a multi-server queue in the Halfin-Whitt regime: as the number of servers n 

grows without a bound, the utilization approaches I from below at the rate 0(1/ y/n). 
Assuming that the service time distribution is lattice- valued with a finite support, we 
characterize the limiting stationary queue length distribution in terms of the stationary 
distribution of an explicitly constructed Markov chain. Furthermore, we obtain an ex- 
plicit expression for the critical exponent for the moment generating function of a limiting 
' (scaled) steady-state queue length. This exponent has a compact representation in terms 

, of three parameters: the amount of spare capacity and the coefficients of variation of inter- 

arrival and service times. Interestingly, it matches an analogous exponent corresponding 
to a single-server queue in the conventional heavy-traffic regime. 
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O ■ 1 Introduction 



In their seminal paper [22] Halfin and Whitt formally introduced an unconventional heavy 
traffic regime for queueing models. Unlike the traditional heavy traffic approach, in their regime 
(dubbed thereafter the Halfin-Whitt regime) high utilization is achieved by simultaneously 
increasing the arrival rate and the number of servers n. This regime is also reffered to as 
^ ' Quality- and Efficiency-Driven (QED) since it balances between the system utilization and 

■ quality of service perceived by customers; the steady-state queue length and waiting time scale 

respectively as 0{^/n) and 0{l/^/n), in some appropriate sense [22]. Moreover, the QED 
regime can be understood as critical with respect to the probability of wait, i.e., the limiting 
stationary probability of wait is strictly in (0, 1) in QED systems (the probabilities of wait 
and 1 correspond to the quality-driven and efficiency-driven regimes, respectively). It should be 
noted that the QED regime was considered by Erlang [15] in the context of numerical steady- 
state analysis of M/M/n and M/M/n/n systems. An asymptotic analysis of the closely related 
Erlang loss function was carried out in [24]. A formal analysis of a queue with exponential 
service times in the QED regime was completed in [22] by Halfin and Whitt. They established 
the criticality of the probability of wait in terms of the square-root spare capacity rule, both 
in steady-state and transient regimes. 
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Queueing models in the QED regime have found apphcations primarily in the area of 
large-scale call and customer contact centers [1,18]. Hence, a number of related models have 
been considered in the literature. Models with customer impatience relevant to call center 
management were studied in [16,19,41]. Approximations that take into account finiteness of 
buffers were introduced in [39,40]. Revenue maximization and constraint satisfaction were 
considered in [2,3,11,30,32]. Optimal stochastic control of QED queues in various settings was 
examined in [5,6,23,37]. The problem of joint control and staffing was studied in [7,20]. Most 
of the aforementioned results assume exponential service times. This assumption significantly 
simplifies the analysis as one does not need to keep a track of residual service times. The 
literature on non-exponential service time distribution is limited. Phase-type service time 
distribution in the transient regime was considered in Puhalskii and Reiman [35]. The case of 
deterministic service times in the steady-state regime was considered in Jelenkovic et al. [25]. 
A more recent work by Mandelbaum and Momcilovic [31] deals with the transient distribution 
of the virtual waiting time in the case of discrete service times with a finite support. A process- 
level limit for the G/GI/n queue for the case of general service time distributions was obtained 
recently by Reed [36]. 

In this paper we examine the stationary behavior of a GI/GI/n system in the Halfin-Whitt 
regime when the service times are lattice- valued and the support is finite. More specifically, we 
consider a sequence of first-come first-served queues indexed by the number of servers n ^ oo. 
The utilization in the nth system is 1— P/^/n+o{l/ y/n) for some parameter /? > 0; equivalently, 
the number of servers n is Rn+(3\/Rn+o{y^Rn), where Rn is the offered load of the nth system. 
The service distribution does not change with n. The stationary number of customers and 
waiting time in the nth system are denoted by Q" and W"', respectively. The first main result 
of the paper states the existence of limiting random variables Q and W such that j^pn =^ Q 
and y/nW^ ^ T^, as n — > oo. The distribution of Q is shown to correspond to the unique 
stationary distribution of some underlying continuous-state Markov chain {{Qt, Lt),t S 
where {Lt,t S Z+} is limiting process corresponding to the vector of customers in different 
stages of service. Our second main result identifies the exact exponential decay rate of the 
limiting variable Q. Informally, we show that F[Q > x] ~ exp{— 2/3a;/(c^ + c^)} for large x, 
where Ca is the (limiting) coefficient of variation of interarrival times and Cg is the coefficient 
of variation of service times. Our analysis uses quadratic and geometric Lyapunov functions 
to establish the tightness of sequences {Q^/^/n,n > 1} and {^/nW^'',n > 1}. 

Next we list some notational conventions used throughout the paper. For two vectors 
X and y with elements Xi and yi, respectively, x ■ y denotes the dot product '^^i^iUi- 
considered vectors are row vectors, and transposition of a vector x is denoted by x'^ . Let 
K = (1, 2, . . . , i^). For x G M™, ||a;|| denotes the Li-norm: ||a;|| = Denote by 

T : — > a linear operator defined by 

T{(xi, . . .,Xk)} = (X2, . . . ,X/f,0). 

For M'^-valued random variables denotes the convergence in distribution. Given a random 
variable (r.v.) X G M, its moment generating function is Mx{0) = "Re^-^ . For every > 0, we 
denote by M.e the family of sequences of r.v.s {X", n > 1} such that limsup^^o^ Mx^ {0) < oo; 
let Moo = De^oMe. Given a r.v. X, we write X £ Me {X G Moo) if Ee"^ < oo (Ee"^ < oo 
for every 9 > 0). We denote by Mt^I-] the expectation operator with respect to a probability 
measure vr; similarly, we use P7r[-] when the probability measure vr is not clear from the context. 
For two reals x, y we set xAy = min{x, y}, xVy = max{x, y}, = xVO and x~ = (— x)"*"; when 
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the argument of a unary operation is a vector or matrix it is understood that the operator is 
apphed element-wise. Symbols and M-|_ denote nonnegative integers and reals, respectively. 

The paper is organized as follows. In the next section we describe the considered model 
and formally introduce the Halfin-Whitt (QED) regime. Our main results are stated in Sec- 
tion [3l Section m contains preliminary results. The proofs of the main results can be found in 
Sections [51 El El and El 



2 Model 

2.1 Queueing system description 

We consider a sequence of first-come first-served queues indexed by the number of servers n. 
The details of our model are as follows. 

Service times. Service times are independent and identically distributed (i.i.d.) r.v.s, 
equal in distribution to a r.v. S that does not depend on n and takes values in a finite set 
{si, . . . ,sk} C M+. It is assumed that the set of service time values has a common divisor 
s > 0, i.e., Si = kiS for some fcj G N, 1 < z < i^. Under this assumption, without loss of 
generality, we adopt s = 1 to be the largest common divisor of service time values. Let pi = 
P[5' = i], < i < -ftT, where K is the largest index such that px > 0. We assume po = 0, that is 
no instantaneous service is possible. Then the expected service time is fi~^ = KS = X^^^ ipi] 
the variance of 5 is denoted by as and the coefficient of variation by Cs = ficTs- The steady- 
state behavior of the system with deterministic service times {S = 1) has been characterized 
in [25] and, thus, we consider ag > 0. In this case there exist two values of the service time 
that are relatively prime, i.e., piPj > for some relatively prime i ^ j; otherwise a simple time 
change argument can be applied to re-scale service times. For convenience let p = (pi, . . . ,pk) 
and p = {pi, . . . ,pk), where pi = F[S > i] = '^j-^iPi describes the tail of the service time 
distribution. 

Arrival times. Customers arrive to the nth system according to a stationary renewal process 
with interarrival times equal in distribution to r„. The arrival rate A„ = 1/Er„, is such that 
\n ^ oo asn ^ CO while the coefficient of variation Ca^n of interarrival times satisfies Ca^n Ca 
as n ^ oo for some < Cq < oo. In view of the assumption 5 G N (s = 1), it is convenient 
to define A^, t € M, as the number of arrivals in the time interval {t — l,t] in the nth system. 
In addition, let a^" denote the backward recurrence time of the arrival process at time t, i.e., 
a" = inf{n > : ^ > 0}, where A^^ denotes the number of arrivals in the time interval 

(s, t] for two reals s < t. Our proving method is based on an analysis of a time-embedded 
process that has a Markov property. Hence, we require that the arrival process has limited 
dependency in its structure. To this end, it is assumed that the appropriately scaled number 
of arrivals, conditioned on the particular value of the backward recurrence time a, converges 
to a Gaussian distribution uniformly in a, i.e., for every t G R, 



(1) 



sup 

a>0 



A- 



An 



< X 



H-1 



W[A < x] 



as n — > oo, where A is normally distributed with zero mean and variance c^. Additionally we 
assume that (since convergence in distribution does not necessarily imply the convergence of 
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moments) that 



(2) sup E 

a>0 

as n — > oo, and 

(3) lim sup sup E 

n^oo a>0 

There exists a broad class of arrival processes that satisfy these assumptions. The simplest one 
is the class of renewal processes with interarrival times that have uniformly in oj^ = a bounded 
conditional second moments. For example, let {Ci,i S ^} be an i.i.d. sequence of nonnegative 
r.v.s with unit mean and a finite second moment. By setting Q/^n to be the ith interarrival 
time in the nth process we obtain a process that satisfies the aforementioned assumptions due 
to the Central Limit Theorem for renewal processes [14, p. 114] when A„ — > oo as ?i — > cxo. 

Finally, since we consider multi-server queues in their steady states, the distribution of 
interarrival times should be such that the stationary distributions of all considered quantities 
exists and are unique (for all finite n). See comments at the beginning of Section [3] and [4, 
Ch. XII] for details. 

Quantities of interest. The number of customers awaiting service in the nth queue at time t 
is denoted by and the total number of customers in the system is denoted by 1^". The fact 
that = n + Q" when all servers are busy while Q" = when at least one server is idle 
renders 

(4) gr = (Y^ - n)+ 

for every time instant t. Let L'^j^, k = 1, . . . , K , he the number of customers in service with 
remaining service times in the interval {k — l,k] at time t. Notation = (L^^,...,L^j^) 
renders ||-L"|| < n, with strict equality corresponding to the case when at least one server is 
idle. The following identity then holds for all t G M+i 

(5) Qnn-\\Ln) = 0. 

Let J"^, k = 1,...,K, be the number of customers with service requirement k that enter 
service during the time interval {t — l,t]; set = {JJ^-^^,... ,Jl^j^)- Thus, ||J"|| is the total 
number of customers that enter service during the time interval {t — l,t] and 

(6) Qt+i = Q? + A7+i-\\Jt+i\\- 



An 



H-1 



< oo. 



2.2 QED regime and scaling 

The offered load in the nth system is A„,/ n and, hence, the utilization is given by pn — A„/(n/x). 
In the Halfin-Whitt (QED) regime the relationship between the utilization and number of 
servers satisfies 

(7) V^(l - Pn) ^ P, 
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as n ^ cxD, for some /3 > 0, or equivalently n = A„//i + A„//i + o{y'Xri/Jj-) as n ^ oo. For 
notational simplicity we let be a quantity satisfying n = Xn/fJ' + f3ny/n, i-e., 

as 71 ^ oo. Under such a scaling, the following centered and scaled versions of r.v.s indexed 
by t G M+ are of interest: 

ir ^ (^r - A„)/^/^, 

(8) jr^{\\jn-K)/v^, 

j':^ij^-\\jnp)/v^, 

K 

(9) ^Y.^h+Qt= (Yr - A„/^)/v^. 

i=l 

Given these definitions, the counterparts of ([1]), ([5]) and ^ are 

(10) = (y; 

and 

(11) = Qt 

respectively. 

3 Main results 

A multi-server queue can be described by the standard Kiefer-Wolfowitz vector [26] of residual 
workloads, e.g., see [4,8]. Provided the stability condition pn = Xn/{nfi) < 1 is satisfied and 
the arrival process is renewal, in [26] it was established that all relevant stationary measures 
exist when the system is observed just before arrivals, i.e., stationary measures exists for this 
particular time-embedded process. In order to ensure the existence of stationary probabilities 
for continuous-time processes {(Q",L"),t G ^+} and {W^,t G M_|_} additional conditions are 
needed [4, p. 348]. We assume that these stationary distributions exists and are unique. Let 7r„ 
be the stationary probability law of {{Qf,L^ ),t £ i.e., vr^ is time invariant with respect 
to t. We characterize the limit of vr^ as n ^ cxo in terms of the stationary probability of a 
certain discrete-time process {{Qt,Lt), t £ Although the processes {{Q2,L^ ),t G M} are 

inherently continuous-time, for the purposes of characterizing their stationary distributions it 
is sufficient to consider their time-embedded versions {t G 7^+ due to the lattice-valued nature 
of service times 5" G N). Such an approach has an advantage since these discrete-time processes 
have a tractable Markovian structure that is amenable to the Lyapunov function method [33] . 



K 



k=l 



t,k 



* _l_ 4" — P 
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Next we construct the Markov chain {{Qt,Lt), t S Z+} with state space M-^+^ To this 
end, let {At, t £ Z_|_} be an i.i.d. sequence of zero mean normal r.v.s with variance /ic^. Also 
let {Jt, t £ Z+} be an i.i.d. sequence of normal random vectors with the zero mean and 
covariance matrix ^S, elements of S defined by 



(12) S 



{1-Pi)pi, l<i = j<K, 
-piPj, l<i^j<K; 



the sequences {At, t £ Z} and {Jt, t £ Z} are independent. The process {{Qt,Lt), t £ Z+j is 
defined by the following three recursions 

(13) Lt+i = T {it} + Jt+i + Jt+iP, 

(14) 



4+1 = (^Qt + At+i + J2 - , 

(15) Jt+i = (Qt + At+i) /\(p-Yl ' 

V k=2 ) 



and an initial condition (QcJ^o) that is independent of {At, t £ Z+} and {Jt, t £ Z^}; the 
random vector {Qq, Lq) satisfies XlfcLi ^o,k < P and Qo{Yl^=i ^o,k — P) = hy definition. It 
is straightforward to verify that the preceding defines a continuous-state Markov chain due to 
the i.i.d. nature of {At, t £ Z+} and {Jt, t £ Z+}. Observe that ([HD, ([H]) and ([l5]) imply, 
for ah t £ N, X;f=i Lt,k < P and 

/ K \ 



Qt[Y.Lt,k-P] =0. 



\fc=l / 

We define a process {Yt, t £ Z^} by Yt = Ylk=i Lt,k+Qt and note that it satisfies Qt = {Yt—P)^, 
t £ we often refer to this process as the limiting number of customers in the queue. 

Our first main result states the existence of a distributional limit of {Q^,L ), as n — > oo, 
where the pair {Q'^,L ) is distributed according to 7r„. In particular, we relate the sequence 
of stationary distributions {7r„,n > 1} of {{Q2,Lt ),t £ ]R+} to the stationary distribution of 
the discrete-time chain {{Qt, Lt),t £ Z^}. The proof is based on a tightness argument and 
can be found in Section [5l 

Theorem 1. 7r„ vr* as n — > oo, where vr* is the unique stationary distribution of the Markov 
chain {{Qt, Lt),t £ Z+j. 

Outline of the proof: The proof consists of three parts: (i) demonstrating that the sequence 
{(Q", Lt),n > 1} is tight with respect to the sequence of distributions {vr^, n > 1} (as n ^ oo), 
(ii) showing that the stationary distribution of {{Q^,Lt ),t £ M+} converges to a stationary 
distribution of {{Qt, Lt),t £ Z+} as n — > oo, and (iii) proving that {{Qt, Lt),t £ Z^} has a 
unique stationary distribution vr*. We briefiy outline the main argument for (i), as the proofs 
of (ii) and (iii) follow more or less a standard argument. 

A polynomial function '^Q{y,z) = {p ■ y + a ■ is defined, with ex. £ being fixed 
(Section WM'-. function ^'i can take negative values. For notational simplicity let Y t — 
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{Yr, Yt-K+i) and = (Z( , . . . , where = Jt + pAf. Based on prelimi- 

nary results (Sections 14. II and 14. 2p the following is derived (Section I4.3P for some set TZ^: 

for some 5 > < oo and all n large enough (Proposition [2]), and 

limsupE^jM/2(r^Znim-i,2^i G 7^"}] < oo 

n— ♦oo 

(Lemma [7]). These two relationships can be combined (Theorem I13p to obtain 

limsupE^J*i(:P;^,Z;^)] <cx). 

n— too 

On the other hand, the expectation of the negative part of '^i{Y^, Z") is also bounded in the 
limit (Lemma [9|) 

limsupE^J-vI/i(:rr,Zr)l{^'i(yr,-^r) < 0}] < oo. 

n— too 

Finally, the tightness of > 1} (and hence of {Q'^.,n > 1} since = (f^" — Z?)"*") with 

respect to stationary {7r„,n > 1} is due to Ett,, [^'i(l^", Z^)] = Ett^Jp • 1^"] = Ej^^Y/^ / jj.. □ 

Let (Q, L) be distributed according to vr^,, i.e., if is the stationary number of customers 
in the nth queue, then Q^/^/n ^ Q as n — > oo. It is immediate that P[Q = 0] G (0, 1) since 
the Gaussian term At in (fT3]) . (HM and (fT5]) has infinite support. The convergence vr^ vr^, 
implies F[Q^ = 0] ^ F[Q = 0] G (0, 1) as n ^ oo, and, thus, the system is indeed in the QED 
regime. 

Our second result establishes the critical exponent for the moment generating function 
of Q. The proof can be found in Section [6l 

Theorem 2. Let 9* = 2(3 /{cl + c^). Then Ee^'^ < oo if 6 < 0* and Ee^'3 = oo if 9 > 0* . 

Outline of the proof: Here we outline just the proof of the statement Ee^'^ < oo if ^ < 0*. 
The key idea is to define a geometric Lyapunov function ^g{y,z) = exp {0p ■ y + 9a ■ z} 
(Section 14. 4p with o; G M.^'^ being fixed. Based on the rules according to which the number of 
customers in the system evolves (Section l4.2p it is possible to define a set TZ (Section l4.4p such 
that 

E[MYt,Zt)l{Yt-i ^n}\Yt-i,Zt-i] < {l-5)MYt-i,Zt-i) 

for ah 9 < 9* 111 and some 5 <l (Proposition EI) , and E^^[^e{Yt,Zt)l{Yt-i G 7^}] < oo for 
> (Lemma llOp . The preceding two inequalities are combined to conclude Etj^^q{Y Zt) < 
oo for 9 < 9*/fi (Theorem I12p and 

E^, [exp{^p-:Pt}] < oo 

follows since Jt and At are normally distributed by definition. Finally, the proof is concluded 
by showing that 



exp{9\Yt/fi-p-Yt\} 



< oo 



for all 9>0. □ 
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The theorem is stated for the Umiting queue length Q. With additional conditions on the 
arrival processes a weaker result can be obtained for the pre-limit variables by only slightly 
modifying the proof of Theorem [2l Namely, it is needed that the arrival process satisfies 



(16) 



limsupsup E 

n—*oo a>0 



< e 



for some c < oo and for every 6 > 0. Then, the following result is established by exploiting 
the preceding relationship. 



Theorem 3. Suppose that ^6\) holds. There exists 9 > such that 

limsupEe^^"/v^ < oo. 

n— >oo 

Proof. See Section [71 



□ 



We conjecture that the threshold value of 9 in Theorem [3] is given by 9* (defined in The- 
orem [2]). We remark that the criticality of the exponent 9* = 2/3/(c^ + c^) is consistent with 
the results obtained earlier in [22,25]. Namely, in the GI/M/n queue in the QED regime the 
conditional limited scaled steady-state number of customers is exponentially distributed [22] 



x-^ logP[Q > x\Q > 0] = -2p/{cl + 1), 

X > 0, while for the QED GI/D/n queue [25] one has, as x — > oo, 

x-MogP[Q > x\Q > 0] ^ -2p/cl; 

recall that in both cases ¥[Q > 0] G (0, 1) for every /? > 0. Furthermore, we point out that 
the same exponent 9* appears in the Kingman approximation [27, 28] for a single-server queue 
in the conventional heavy-traffic regime. Moreover, the same exponent was established in 
analyses of queues with a fixed number of servers in the same heavy-traffic regime. 

In particular, consider a sequence of single-server queues indexed by n. The arrival rate to 
the the nth system is — > oo, with the arrival process being renewal, satisfying the Central 
Limit Theorem and Ca,n ^ as ?i ^ oo. The service times of customers are i.i.d. and equal 
in distribution to S/n (equivalently, the service capacity grows linearly in n), and, thus, the 
utilization is given by pn = Xn/{np). Let be the steady-state number of customers awaiting 
service in the system indexed by n; and the total number of customers in the system differ 
by at most one at any point in time. If \/n{l — pn) — > /? > 0, as n ^ oo, then Q'^/y/n =^ Q, 
as n — > oo, where Q is exponentially distributed [38, Sect. 9.6] (see also [38, Sect. 5.7]): 

x-MogP[Q > x] = -9*, 

X > 0, where 9* is as in Theorem [2j The agreement of the critical exponent 9* in the cor- 
responding single- and n-server (n — > oo) systems is interesting since the two evolve under 
different rules. Observe that, as n ^ oo, the total number of customers in the single-server 
system is Q{^/n), as n — > oo, while for the re-server system that quantity is 6(n), as n — > oo. 

In conclusion of this section we obtain an analogue of Theorem [2] for waiting times using 
the Distributional Little's Law [21] applied to the waiting room. In the case of process-level 
(transient) analysis a result of [34] (see also [35, Lemma A. 2]) is utilized typically to make a 
"translation" between the queue length and waiting time processes. Here we provide a simple 
independent proof for the stationary waiting time W^. 
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Corollary 1. If W = then y/nW"' =^ W as n ^ oo. Consequently, Ke^^ < oo if 

9 < fi0* and Ee^^ = 00 if 9 > fiO*. 

Proof. See Section [HI □ 



4 Preliminary results 

The section contains 4 subsections. In the first subsection we consider a time-embedded version 
of {{Q2,L^),t G K+l- The number of customers in the finite-n and Hmiting systems is con- 
sidered in the second subsection. Quadratic and geometric Lyaponov functions are introduced 
and analyzed in the last two subsections. 



4.1 Time-embedded process 

In this section we examine the triple (Q",Z", 04) G Z;^^^ x R-^ and the laws governing its 
evolution in time. The process {{Q^ , , a'^) , t E is not Markovian due to the non- 

exponential nature of service times. Hence, in order to avoid enlarging the state space, we 
consider its time-embedded version {(Q2,L2,a^), t S i.e., the original process observed 
at discrete-time instances t £ Z4. (recall from Section [2. II that 5 G N). As seen in the following 
proposition, the evolution of the later process is determined by the number of arrivals {A'^) 
and customers that enter service (J^) during a unit time interval. 

Proposition 1. The process {(Q", Z", a"), t £ Z+j is a Markov chain. For every t E Z4. the 
value of {Q'^_^-^^, L^_^_i) satisfies 



(17) L^^,=T{Ln + J7+i: 

(18) Qr+i = {Q? + ^r+i + ii^ni - ^ - Li,y , 

where J^j^i G Z;^ is a multinomially distributed random vector that obeys 

(19) II jr+iii = (Qr + ^r+i) a (n - + l^j 

and 

(20) E[J^'+i|||jr+i||] = ||Jr+il|p; 

given ||J^^_;^|| vector JJYi conditionally independent of {{Q^ , L"^ , a"^) , t G Z+j. 



Proof. It is sufficient to demonstrate (jl7p . (jlSp and (jl9p : equality (|20p is a straightforward 
consequence of the i.i.d. nature of service times. The Markov property follows from these 
relationships and the renewal structure of the arrival process. 

Consider the number of customers that enter service in the time interval {t,t+l]. At time t 
there are ||-L"|| customers in service by the definition of -L". Out of these ||-L"|| customers, L^i 
depart from the system not later than time (t + 1) since their residual service requirements at 
time t are at most 1 (by the definition of Lf^). This yields that n — \\Lf\\ + L^i customers can 
potentially enter service in the time interval {t,t + 1]; recall that n — \\L^\\ is the number of 
idle servers at time t. On the other hand, the number of customers that can enter service in 
(t, t + 1] is at most Qf + ^"+1- Thus, the number of customers that enter service in (t, t + 1] is 

(21) II jr+iii = (Qr + ^r+i) a (n - nzrii + ^m), 
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rendering (jl9p . Now, customers in service at time t + 1 with residual service requirements in 
(i — are of two types: (i) customers already in service at time t, and (ii) customers that 
do enter service in + 1]. Thus, formally 



(22) L 



t+l,i 



^t,i+i + "^t+i,i' i — 1, ■ ■ ■ ,K - 1, 



The multinomial distribution of J^j^i follows from the assumption that customers' service 
requirements are i.i.d. r.v.s, independent from the arrival processes. Rewriting (j22p in a vector 
form renders (jl7p . 

In order to establish the value of Qf^i, it is sufficient to consider the difference between 
the number of customers that could start receiving service in the time interval (t, i + 1] and 
the actual number of customers that enter service, i.e., ([6]) and (j2ip yield 

Qt+i = (Q" + ^r+i) ~ ll'^t+ill 

= (Q'^ + A^^, + \\LU-Ll,-n)+, 

and (jlSp holds. This concludes the proof. □ 

An analogue of Proposition [1] for scaled processes is stated next. 
Corollary 2. The process {{Q'f,L^ ,a"), t G Z+} is a Markov chain and it satisfies 

(23) ir+i = m:} + + jr+^p, 



where Jt^i conditional on J'lj^i is independent of {{Qf , ,a"), t G Z+j. 

Proof. The Markov property follows from Proposition [1] and the fact that there exists a one- 
to-one mapping between {Q2,L^ ) and {Q^,L^). Now, (fT7|) implies 

i.r+i-AnP = T{i:r}+jr+i-A„p 

= (Tizr} - A„(P-P)) + (Jr+i - Pmllp) + {\\Jt+i\\ - An) p. 

This equality and the observation T{ly" — XnP} = T{L^} — Xn{p — p) (due to the definition 
of p) yield (j23p . The remaining relationships are obtained similarly from their counterparts 
([ID and ([191). □ 



Properties of the vector are summarized in the following lemma. 
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Lemma 4. Vector satisfies for every k = 0,1, . . . ,n and 9 > 



E 



E 



jn 



E 



exp ^eK • j"} 



\Jt\\=k 



\Jt\\=k 



\Jt\\=k 



kal/n. 



kpj{l-pj)/n. 



„ s-i/V 

Ee 
< ( Ee 



Proo/. Let {5J*Li be a sequence of i.i.d. r.v.s equal in distribution to S. Then, the definition 



of renders 



E 



K J, 



ME 



Si - 



n 



ka1/n. 



The other two equahties are obtained in a similar straightforward fashion. The inequality is 
due to Ee^^'^"^/^-*/^ > 1. This follows from the convexity of in x and Jensen's 

inequality. □ 



4.2 Number in system 

This section is devoted to the detailed analysis of the rescaled number of customers in the 
system {Y^,t G Z+} and its limiting counterpart. The dynamics of {Y^,t G is related to 
a newly introduced process 



(24) 

and in particular to 
(25) 

(26) 



Z'; = {Zl„...,Zlj,)^j';+pA^ 



^" = EX;(^r+i-„+P.ir+i- 

i=l j=i 
K K 

1=1 j=i 



as stated in the next lemma. Informally, for large n, process { V^", t G serves as a proxy for 
a scaled infinite-server process. We remark that the lemma is a discrete-time analogue of (1.1) 
in [36]. 

Lemma 5. The process {1^", t G Z_|_} satisfies for all t > K 

K 



i=l 
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Proof. Equalities ([23]) and yield an expression for the Kth element of the vector 

Lt+1,K = Jt+1,K + (^"+1 +Qt - Qt+l)PK- 



Furthermore, using (j23|) iteratively it is straightforward to obtain the remaining elements of 
Ln_^_i. To this end, for j = 0, . . . , K — 1, 

j j 

^t+l+j,K-j = ^ Jt+l+i,K-i + ^(^t+l+i + Qt+i ~ Qt+l+i)PK-i, 
i=Q 1=0 

which after a change of time indices renders, for t > K and j = I, . . . ,K, 

K+l-j K+l^j 

(27) Li^= J?+l-^,+^-l+ E (^m-i+or-.-Or-i+iM+i-i- 

i=l i=l 

Summing both sides of (j27p over j = 1, . . . , X and using (j25p results in 

ft: k 

E ^"i ~ E E "^W-iJ + + QF-j ~ Qt-i+l)Pi 

j=l i=l j=i i=l 

i=l 

The statement of the lemma follows from the preceding equality, ([9]) and (jlOp . □ 

The following corollary establishes a lower and upper bound on the value of in terms 
of the past values of G Z+j and the process {Vf^,t G 

Corollary 3. (i) For every k G and t > + K 

fc k+K 

j=0 i=k+l 



(ii) For 1 < ii, . . . ,ik < /ei = n^=iPjj ^'^'^ ^(^) = Sj=i '^('-') ~ ^' ^^^^ /' 

t > s{k) 

Yr>p{k)Yr-sik)-E(f^-Vt-su)r- 

j=0 

Proof. The proofs of the two parts are by induction on k. 

(i) The base of the induction (fc = 0) is due to Lemma[5]and pi > pi for i = 1, . . . ,K. Then 
the bound follows from the inductive assumption, Lemma [5] and pi = pi + pi+i < 1: 

fc k+K 

Yr < E(^"-)^ + (yt-k-i^ + E p^-^i^r., - 

i=0 i=k+2 
fc+1 k+l+K 

<E(^*^)^+ E P^-k-l{Y^_i-Pnr. 
i=0 i=k+2 



or 
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(ii) By Lemma [5] one has Y/^ > V^" — that imphes 

(28) >p,,Yr.,,-{p-vrr. 

The preceding inequahty provides the base of the induction (/c = 1). Suppose now that the 
statement of the corollary holds for some k > 1. Then combining (I28p , the inductive assumption 
and Pi < 1 yields 

Yr>p{k)Y,l,^,^^-Y.{f3-Vt-sU)V 

k 

> p{k + - ^{p - Vt-su)^, 

j=0 

where the second inequality is also due to s{k + 1) = s{k) + ik+i- □ 

In the rest of the section we state the limiting counterparts of the results derived for 
G ^+}- We start by introducing the limiting analogs of and V^". Define 

(29) Zt = Jt+pAt 
and 

K K 

i=l j=i 
K K 

(30) =5^5^it+i_,,„ 

■t=l j=i 

where Zt/s are the elements of Zt- Since Jt and At are normal r.v.s by definition, Zt is 
normally distributed as well and for all t and i we have 

(31) l4de-^oo. 

The properties of t G are summarized in the following lemma, including a limiting 
counterparts of Lemma [5] and Corollary O 

Lemma 6. (i) The process {Yt,t G satisfies for all t > K 

K 

Yt = Vt+Y,P^{Yt-^-P) + . 
i=l 

(ii) For every t G 

i-Yt) G Moo. 

( Hi ) For every k G Z+ and t > k + K 

k k+K 

Yt<Y,{yt~^)^+ E P^-k{Yt~^-|i)^. 
1=0 i=k+l 



13 



(iv) For 1 < ii, . . . ,ik < K let p{k) = Ilj=i Pij ^'^^ ^i^) ~ X]j=i h with s(0) = 0. Then, for 
t > s{k) 

Yt > p{k)Yt-s(k) - JZiP - Vt-s(j))^- 

j=0 

Proof, (i) The proof is analogous to the proof of Lemma [5l Part (ii) follows from Yt > Vt 
(i) and the fact that At and Jt have normal distributions. The proofs of (iii) and (iv) are 
analogous to the proof of Corollary [3l □ 

4.3 Quadratic Lyapunov function 

Here we introduce a quadratic Lyapunov function and prove some of its properties. To this 
end, we define K vectors ai, . . . , ax, where elements of the vector = • • • , ctk^x) are 

defined by 

(32) ak,j = (j - k)+; 

let ct = {cti,...,ctK) £ Let a function ^'^(y, z) : IR^+^'' ^ M be defined by 

(33) ^e{y,z)^{p-y + a-zf 
and a set TZx by 

(34) n^^ly e M^^ : < X for some i}. 

The case = 2 is of particular importance since it corresponds to a quadratic Lyapunov 
function (see Appendix B for the definition) as established below. Finally, we introduce = 
(yj", . . . , Yf^j^_^_i) and = (Z^ , . • • , Zt_K+i)'-, the "bar" symbol in Yt and Z" indicates that 
elements of these vectors refer to different time indices. 

Proposition 2. There exist 5 > 0, ip < oo and uq such that for all n > uq 

E z7) l{Yti ^ - MYti, ~zU) I YU. zti] < -^^i{Yt.. zt,) + V'. 

Proof. On the event {i^"„i ^ ^Ai} Lemma [5] renders in a vector form = — l3n-\-p-Y^_i, 
and, since pi + pj+i = pi by definition, it implies p ■ Yt = Vt"' — jSn+p - • Thus, the linear 
combination of Yt and Zt that appears in the definition of can be expressed as 

p.Y'l + cx-Z'^ = Vt''-Pn+p-Yti+a- Z'i 

(35) = p • ^P^-i + « • Zti - /?„ + K • Z", 

where the second equality follows from (j32p and (j26p . Then, based on (j35p . we obtain 

E [^,{Y-, Z^YU i ^aJ I ~ZU] - ^2(^-1, ~zU) 

(36) 



<2^i(yti,-^r-i)E -^, + K.Zt \ Yti,Zt-i 



+ E 



[-i3^+K.z:y\Yii,zt, 
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Now, by (j24p the sum in ()36p can be expressed in terms of Af and rendering 



E 



K.Z';\Yt„Z 



(37) 



E 
E 



A^/f,\Yt„Zl 



< supE 

a>0 



t-i 



where the last inequaUty is due to the fact that A" is conditionally independent of Jf. and 
{Y^_i, Z^_i) given at-i (the arrival process is renewal). The second expectation on the right- 
hand side of (I36p can be upper bounded by utilizing the the same fact in addition to observation 
that J I is conditionally independent of and (1^"_^, Z^_i) given J" - see Corollary [2j These 
two facts yield 



E 



(38) 



< supE 

a>0 

< supE 

a>0 



Y 

^r//^-/3n 
ir//^-/3n 



E 



H-l 



^r//^-/3n 



+ max E 

0<i<n 



t-i 



t-i 



I 7"" 



where the last inequality follows from Lemma U] and || < n. The limit (as n — > oo) of the 
right-hand side of the preceding inequality remains bounded due to the assumption ([3]) on the 
arrival process (Section 12. ip and the fact that service times are bounded {S < K). 

Combining (f36|) with (f37|) . Q and ((38]) yields the statement of the theorem. □ 

Lemma 7. The following inequality holds 

limsupE.„ [*2(n, Z'i) l{Yti G < oo. 

n^oo 

In the proof of the lemma the following number-theoretic fact will be utilized. For com- 
pleteness we provide its proof. 

Lemma 8. Let p and q be two relatively prime numbers. For any JiT € N there exists /c G N 
such that any I & {k + 1, . . . ,k + K} can be represented as I = iip + jiq for some iuji G N. 

Proof. Since p and q are relatively prime then any m G {1,2, can be represented 

as m = i'^p + j'^^q for some possibly negative integers i'^ and j^, see e.g. [29, p. 104]. Let 
t = maxm{iji,i^} + 1 and k = tp + tq. Then every I £ {A; + 1, . . . , A: + K} is given by 
l = ilP + jiq, where i; = (t + ;,) and ji = {t + □ 

Proof of Lemma^ Let TZ^ = {u ^ ■ Vi > x,. . . ,yk-i > x,yk < x}, 1 < k < K. It is 
sufficient to prove the statement of the lemma with TZp^ replaced with TZ^^ for an arbitrary 
A; G {1, . . . , K} since TZj3^ = U^T?.^^. The proof is based on demonstrating the following bound 
for some positive integer m and constants {ci,i = 0, . . . ,m + k + K} , {di,i = 0, . . . ,m + k + K} 
such that for all n 



(39) 
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Then the statement of the lemma follows from the definition of VJ", Lemma H] and ([3]) applied 
in the unconditioned case; thus, we focus on demonstrating (I39p . 
On event {Y^_i G T^^^} applying Lemma [5] to Y^^ yields 

k-l K 
j=l i=fc+l 

(40) =v;" + ^<^,(y«^ ^ 

i=l i=fc+l 

where the constants gfj's and /ij's can be computed in a recursive fashion: 5(0 = 1, = 
X;}=o for i = 1, . . . , - 1, and /li = Ej={i-A')+ djVi-j^ for i = /c + 1, . . . , + /c - 1. 
Hence, based on (140 p . there exist finite and h such that 



(41) vn< 5E(v;ij+ + (^;"-j+. 

i=0 i=A:+l 

Next, on the event of interest, € ^^^li upper bound the second sum in (j4ip in two 

steps: (i) bound values of G Z+} on a time interval of lenght K prior to time (t — /c) 

based on {Y^_^ < and (ii) obtain a desired bound based on (i). First, consider arbitrary 
h,i2 1^ K such that Pi^Pi2 > 0; such a pair of indices exists since > (see Section [27T]) . By 
Lemma[8]there exists a sufficiently large m such that every element of {m+1, m+2, . . . , m+K} 
can be represented as riii +r2i2 for some nonnegative integers ri and r2. Invoking the second 
part of Corollary [3] and {^("^ < /?n} yields the existence of finite r, q and m> K such that 

j=fc 

for all i G {m + 1, . . . , m + iC}; we also used |x + y| < |x| + \y\ and the fact the elements of 
the sum are nonnegative. The preceding inequality and the first part of Corollary [3] assure the 
existence of finite r' and q' such that 

K+k-l m+k+K 

(42) h J2 iy^-^r < r' + q' 

i=k+l i=k 

since each summand on the left-hand side is upper bounded by an expression that appears on 
the right-hand side with r' and q' replaced by some other finite constants. 

Next, combining ([IT]) and (|12]) provides a bound on p • in terms of V^", . . . , V^^^_j^_j^: 

k-l m+k+K 

i=0 i=k 
m+k+K 

<r'+g' Y 
i=0 

where g' is finite. Finally, from (126p we have that the absolute value of a ■ is upper 
bounded by a linear combination of |V^"j|'s. Then, ()39p follows from the preceding bound. 
This completes the proof. □ 
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Lemma 9. The following inequality holds 

limsupE,„ [-*i(;P;^,Zni{^i(^r,-^r)<0}] <oo. 

n— >oo 

Proof. Lemma [5] renders > that leads to 

i=\ 

The statement follows from the preceding relationship, ()25p . Cauchy-Schwarz inequality, ([3]) 
and Lemma m □ 



4.4 Geometric Lyapunov function 



In this section we introduce a family of Lyapunov functions parameterized by some > 
and prove some of its properties. Given a parameter ^ > 0, consider a function ^^iy^z) : 
1R^+^' ^ defined by 

(43) 



^e{y, z) = exp {Op ■ y + Oa ■ z} . 



We first consider $e as a function of the limiting pair (Vt, Zt), where Yt = (Ij, . . . ,Yt-K+i) 
and Zt = {Zt, ■ ■ ■ , Zt-K+i)- The next proposition establishes a negative drift of the Lyapunov 
function under an assumption 6 < 9* / fi. Moreover, 6* / fi is the critical exponent under 
which is a geometric Lyapunov function (see Appendix B for the definition). Recall the 
definition of TZx from 



Proposition 3. For every 9 < 9* / ^ there exists 5 = dg > Q such that 

(44) E [^g{Yt, Zt) l{Yt-i i Tlf,} |yt„i, Zt-x\ < (1 - 5) ^g{Yt-x, Zt^i) 
and for every 9 > 9* /fi there exists 5 = 6g > such that 

(45) E [MYt, Zt) \Yt^i, Zt^i] >{l + 8) ^g{Yt^i, Zt^i). 

Proof. The analysis is similar to the one of Proposition [2j From Lemma [6)^i) we have that on 
the event {Yt-i ^ 7^/?} 



(46) 

This results in 



p-Yt + cx-Zt = Vt- (3+p- Yt^i + cx-Zt 

= p ■ Yt-i + a • Zt-i -p + K-Zt. 



E [MYt, Zt)l{Yt^i i Tlfi) I Yt-x, Zt-i] 



-BP 



< e" 



(47) 



E 

'e 
'e 



exp [9K ■ Zt] l{Yt^i i Tip] \ Yt^i, Zt-i] ^g{Yt-i, Zt-i) 



exp^K-Zt \Yt-i,Zt-i 



^e{Yt-i,Zt-i] 



E 



} 

expj^K- Jt}] ^giJt^X.Z 
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where the last equaUty follows from the definition of Zt^ mutual independence of and Jt 
as well as their independence of (Yt-i, Zt-i). By definition, r.v. At is normally distributed 
with zero mean and variance jic^ and, hence. 



(48) 



E 



On the other hand, Jt is normal with the covariance matrix = /u(diag(p) — 'p^Tp) (see ([12 
where diag(p) is the diagonal matrix defined by p. Thus 



E K • Jy 



/iK^(diag(p)-p^p)K 



K 



which in turn implies 



E 



^^2/(2/.) 



expj^K- Jt 

Inequality (j^7|) . ([18]) and the preceding equality result in 

E [MYt, Zt)l{Yt-i i np] I Yt^i, ~Zt^i] < e-^^e^''=^/(2A')e^''=^/(2/^)<I.,(yt_i, Z^^i), 



and (144p then follows provided that 

-ei5 + ^2c2/(2^) + e'^cl/{2ii) < 0, 

or equivalently 9 < 0*/fj,. Therefore, the first part of the proposition is established. 

The proof of (145p is very similar. We observe from LemmalHi) that Yt > Vt — P + p- Yt-i, 
regardless of whether Yf-i £ TZp or Yf-i TZp. Repeating the analysis for the previous case 
(9 < 9* /n), we obtain 



E[MYt,Zt)\Yt-i,Zt^i] > e 



E 



e^p{9K-Zt] \ Yt~i,Zt^i\ MYt-i,Zt-i) 



thus, (j45p holds provided that 9 > 9* /fi. This concludes the proof of the proposition. 



□ 



The following analogue of Proposition [3] is needed to establish our third main result, The- 
orem [3l 

Proposition 4. There exist 9 > 0,0 < 6 < 1 and no, such that for all n > no, 
(49) E [MYl i np^} ~Zli] < (1 - 5) ^e{YU, Z'U). 

Proof. Repeating the first steps of the proof of Proposition [3l we obtain 



E 



= e-'P- E [exp [9K ■ z']] ^{Y'U i n,.. ] \ Y^.K-, 



(50) 



< e"'''^" E 



exp{0K.z:} 



^,(Y 
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Now, the expectation in (jSOp can be expressed in terms of Af and the following way 
(51) E [exp [ex • Z"} I Yl„ Z^i] = E [exp [oA^/fi + OK • j"} Ir^-i, Z^, 

The right-hand side can be upper bounded by utilizing: (i) A" is conditionally independent of 
Jj. and {Y^_i, Z'^^i) given at-i since the arrival process is renewal, and (ii) is conditionally 
independent of Af and Z"_]^) given J" (see Corollary [2]) . These two facts and (jSTj) yield 



E 
(52) 



exp{^K•Z"}|r^l,Z^l 



< supE 

a 

< supE 



expj^ii:- j"} wm 

^^e(s~i/fi]/V^') 



max E 

0<Kn 



where the second inequality follows from Lemma [H Using a second order Taylor expansion in 
conjunction with the observation that service times are bounded {S < K), we have 



(53) lim (Ke^(S-i/f.)/V^\ ^ ^^^^ i + ^ + o(l/n) 



e^'-^/2 < oo. 



Finally, from (l53]) . (j52]) and (l50]) we conclude that (1491) holds for 9 that satisfy 

that, in light of Pn — > is satisfied for sufficiently small 9. This establishes (H9]l and concludes 
the proof. □ 

The analogue of Lemma [7] for the geometric function applied to the nth and limiting 
processes is stated next. The proof is very similar to that of Lemma [71 except that the fact 
that At and Jt are normally distributed is utilized in the limiting case. 

Lemma 10. For every 9 > the following assertion holds 

E^. [<^e{Yt, Zt) l{Ft_i G Tip}] < oo. 
Moreover, under the assumption U6\) . for every 9 > 

limsupE^„ [MYt,Zt) H^t-i e T^pJ] < oc. 

n—>oo 

Proof. As in the proof of Lemma [71 it is sufficient to prove the statement of the lemma with 
TZp replaced with 7?.^^ for an arbitrary A; G {1, . . . ,K}. Repeating the steps of the proof of 
Lemma [7] yields the existence of some positive integer m and constants Cj's, dj's such that 

'm+k+K "1 



$9(rt,Zt)l{l^t-i G7^J} <exp 



^ {ci+d,\vt-i\)y 

i=0 J 



Then the statement of the lemma follows from the definition of Vt, the Gaussian distribution 
of its components and Proposition [7| in the appendix. 

The proof of the second inequality is very similar and uses (jl6p and Lemma [H □ 
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5 Proof of Theorem [T] 

The convergence in the statement of the theorem is estabhshed by proving the tightness of all 
relevant random variables. Recall that a sequence of r.v.s {Xn,n > 1} is tight [14, p. 87] if for 
all e > there is an so that 

sup F[Xn i < E. 

Proposition 5. The sequence {Y^^n > 1} is tight with respect to the sequence of probability 
measures {vr„,n > 1}. 

Proof. Theorem 1131 can be used to bound the sequence {Y^,n > 1} away from +oo. In order 
to obtain uniform boundedness away from — oo we utilize the fact that the negative part of Y^^ 
can be upper bounded by {Vf^)~ according to Lemma [6]^i). 

From Proposition O Lemma [3 Lemma [9] and Theorem 1131 it follows that 

limsupE^„^i(r",Z") < oo. 

n— >oo 

Applying (|26p . ^ and Lemma H] we obtain from (|33p in the case 9 = 1 that 

(54) limsupEyr^p • < oo. 

n— >oo 

Next, Lemma [5] implies Y^" > V"' leading to 

which combined with ()25p , Lemma [4] and ([3]) yields 

(55) limsupE^„(yt")- < oo. 

n— >oo 

Now, in view of = 1 we have 

2<k<K 
2<k<K 

and it then follows from (j54p and (I55p that 

limsupE^,^^^"' < oo. 

n— >oo 

This bound together with (j55p and Markov inequality implies the tightness of the sequence 
{Y^,n > 1} with respect to the sequence of distributions {vr„,n > 1}. □ 

For the purposes of the proof of Theorem [T] it is convenient to define a sequence of stationary 
random processes 

{ t: = (Or, ir, J?, Y^, ar) , t e M+} 

indexed by n. Assume that {Qf,L^,af) (or equivalently the extended process Tj ) is dis- 
tributed according to 7r„ for all t G (see Section [3|) . 
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Corollary 4. For a fixed t > 0, the sequence {Tj , n > 1} is tight with respect to the sequence 
of probability measures {7r„,?i > 1}. 

Proof. The tightness of random variables {Af,n > 1} follows from ([3]) and the tightness of 
{Y^, n > 1} is due to Proposition [5l The tightness of {Qf, n > 1} then follows from ()10|) . and, 
thus, (llip implies the tightness of {J",n > 1}. The tightness of {jp,n > 1} implies via ([8]) 
that II J" II /(^n) — > 1 with probability 1. Recalling that conditional on J" is independent 
from all the other r.v.s (Corollary [2]), we obtain tightness of the sequence {J^ ,n > 1}. Finally, 
applying iteratively (p3]) of Corollary [2l we obtain the tightness of L^j^, L'^j^_^ and L"^. 
Tightness of a" follows from the equilibrium assumption of the arrival processes, which implies 
that Eof = (c^„ + 1)/(2A„) = 0(l/n), as n — > oo, due to our assumption Ca,n — > Ca < oo as 
n ^ oo. This completes the proof of the corollary. □ 

The preceding result implies the weak convergence of 7r„ along some subsequence {n^, k > 
1} to some limiting probability measure ir^, [10, p. 59]. For now let vr* be any such limit 
measure. Later in this section we establish the uniqueness of vr^,. Observe that the tightness 
of {Tf,n > 1} implies the tightness of {(Tf,Tf+i),n > 1}. 

Proposition 6. Let {T]^,t G Z+} be in stationarity and suppose {T^,T^_^_l) (Tj,Tt+i), 
as n ^ oo, for some {'tt,'Tt+i), where Tt = {Qt,Lt,At,Jt,Jt,Yt,dt). Then the r.v.s At+i 
and are independent. 

Proof. By ([T]) and ([7]) it follows that Af+i is equal in distribution to At^i. One needs to show 
that for every real a and b 

(56) P[if+i < a, tt < &] = P[it+i < a] P[Tt < b], 

where for the vector case "<" is interpreted coordinate-wise. Given a multidimensional r.v. X, 
recall that a vector x is defined to be a continuity point if P[Xj = Xj] = for every coordinate i; 
it is known that the set of continuity points is a dense uncountable set (see [14, Sect. 2.9]). 
Since distribution functions are right-continuous, it suffices to establish the identity (|56p for 
the case when a and b are continuity points of At+i and respectively, as in this case, by 
density property, we can find a sequence of continuity points (a^, bn) [ (a, &) as n — > oo. Thus, 
one needs to establish (|56p with a and b being continuity points. 

The key to the proof is the observation that, conditional on the backward recurrence 
time a", r.v.s A2_^_l and Tj are independent, i.e., 

/•CO 

<aX<b]= P[iJVi < « I < = ^]P^„ [t: < fa I a? = z] dF[a^ < z] . 
Jo 

By assumption ([T|) we have 



sup 

z>0 



P[AJVi <a\a7 = z]- nAt+i < a] 
for all sufficiently large n. Therefore, for all such n the following holds 

/•oo 

P.„ [ir+1 < a, *r <b]< (P[it+i <a]+e) P,„ [t" < 6 |< = z] dP[< < z] 

Jo 



<F[At+i<a]¥^jrt <b]+£. 
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Recall that b is a continuity point of . Then the weak convergence ^ implies 



"^t ^ b] ^ < 6] as n — > oo, resulting in 



limsupP^jir+i < a, ti < 5] < ¥[At+i < a] P[Tt <b]+e. 

n— >oo 

Similarly we establish 

liminf P^ jijli < a, t" < b] > P[it+i < a] P[Tt < 6] - e. 

n— >oo 

On the other hand, by the assumed weak convergence one has P7r„ [4fYi < a, < b] — > 
P[^t+i < a, < fo] as n — > oo since (a, b) is a continuity point of the vector {At+i,'Tt). 
Parameter e is arbitrary and, hence, the assertion of the proposition follows. □ 

We developed the necessary tools for proving Theorem [TJ In the proof, we show the exis- 
tence of a weak subsequential limit of Tj , as n ^ oo, that must correspond to the stationary 
distribution of the Markov chain corresponding to (fT3|) . and (fT5|) (Section [3|). In the second 
part of the proof we argue that a stationary distribution of this Markov chain is unique. 

Proof of TheoremUl (Part I.) By Corollary [5] there exists a subsequence {nfc,/c > 1} along 
which a weak convergence (Tj 'T^^^i) =^ (Tj, Ti+i) as A; — > oo takes place [14, Sect. 2.2] for a 
fixed t and a pair of random vectors T. = [Q., L., A., J., J.,Y.,d.) . The Continuous Mapping 
Theorem [10, Sect. 2] yields the following weak limits along {nk,k > 1}: 

K 

Qt + At+i + Ltj - p 
i=2 




K 




{Qt + it+i) A 



Then from the preceding and Corollary [2] the following relations follow for the elements of "Tt 
and Tf+i: 

Lt+i = T{Lt] + Jt+i + Jt+iP, 
Qt+i = l^t + At+i + Uj - f3 

Jt+i = {Qt + At+i) A 1^/3 - ^tJ 1 • 

Now, note that Af At and =^ Jt as n ^ oo for every t G Z+. These weak limits are 
due to central limit theorems for renewal processes [10, p. 154] and vectors in [9, p. 385], 
respectively. Moreover, At and Jt sue independent in addition to the independence of At+i 
and Tf (see Proposition [6]). Since 7r„ is the stationary distribution of Tj , we obtain that 
the distribution of Tt coincides with a stationary distribution of the Markov chain specified 
by (US]), (HH) and 
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(Part II.) We established in the previous part that every weak subsequential hmit Tt of 
is a stationary distribution of the Markov chain defined by (jl3|) . (jl4p and ()15p . It remains 
to establish the uniqueness of the stationary measure tt-^ of {Tt,t G The uniqueness 

of the limit measure implies also the convergence 7r„ ^ vr,,,, using standard results of weak 
convergence theory [10, p. 59]. 

The proof of uniqueness uses the framework of Harris chains and Harris recurrence. All 
of the definitions and results are adopted from [14, Ch. 5]. Recall that the Markov chain 
{(Qt, Lt),t G Z4.} is a Harris chain if one can identify two (measurable) sets A, B C R^+^ and 
a probability measure u concentrated on B such that for every x G 



E 

t>o 



F[{Qt,Lt)eA\iQo,Lo)=x]>0, 



and there exists e > such that for every C C B 



(57) 



inf ¥[{Qt+i,Lt+i) G C I {Qt, Lt) = x]> ev{C). 



Moreover, if these conditions hold for some B = A, and the Markov chain possesses a stationary 
distribution, then the Markov chain is also mixing, and as a result the stationary distribution 
is unique (see [14, Theorem 6.8] and the comment on aperiodicity just preceding it). Note that 
if TT is a stationary distribution of {{Qt, Lt), t G then vr is also a stationary distribution of 
{{Q2Kt, L2Kt),t G In view of this, (f57l) can be replaced by 



(58) 



inf n{Qt+2K, Lt+2K) G C I {Qt, Lt) = x]> ev{C). 



Thus, our task of proving the uniqueness of the stationary distribution n^, is reduced to 
constructing the set A = B satisfying the assumptions above. For this purpose we set 



A 



K+l 



X G M^+^ :xi = 0, y \xj\ < P/K"^ 

J=2 



Namely, {Qt, Lt) G A implies that the queue length Qt is equal to and each Ltj, 1 < j < K , 
is upper bounded bounded by in absolute value. We set ;B = ^ and claim that A satisfies 

the requirements when is the uniform distribution on A. For a pair of positive constants c, C 
define an event U by 



K 



U 



\l At+i <-c\r\ 




and note that P[Z//] > due to the Gaussian nature of Ats. 

First, we show that ¥[{Qt+2K , Lt+2K) G .4 | {Qt,Lt) = x] > Q for every x. To this end, 
given (fT3l) . (fH|) . (fT5|) and {Qt,Lt) = a^i there exists C large enough so that 



(59) 



K 



Qt+K = 0, \y Lt+K,i < —p 



i=l 



u 



> 0. 
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To verify this claim note that (jl3p imphes 



K 

(60) Lt+K,i = ("^i 

+K+i~j,j + PjJt+K+i-j I , 

j=i 

and that F[\/fj^i\Jt+ij\ < e] > for any e > due to the normal distribution. Then, by 
selecting C > pJ^^{Qt + Ylf=i \^t,i\ + P + sK) and e small enough, recursions (fl^ and psp 
render, on the event U n {\/fj^i\Jt+ij\ < e}, to 

4+1 = 0, 

Jt+i = Qt + A+i < -PkHP + ^K), 

leading to Lt+i^K <£ — /? — £K by ([50]) . Next, on the same event = 0, J(+2 = < 

~P~KiP + Lt+2,K < — — 1) and L(+2,_ft:-i < — /? — - 2). Further iteration 
over the time index and (j6U|) yield (j59|) . 

In addition, for c small enough in the definition of ^, on event {Qt+K = 0, ViLt-^-K,i < — 
we have Qt+K+i = and Jt+K+i = M+K+i for i = 1, . . . , ii' by a similar argument as above. 
Then the components 2, . . . , K + 1 of {Qt+2K, Lt+2K) are bounded in absolute value by P/K'^ 
provided that 

K ( K 

(61) = 5^ Jt+2K+^-j,J G I [-P/K\P/K^] -Y, PjAt+2K+^^j , 

j=i y j=i 

for i = 1, . . . , K. We denote by £ the conjunction of U and the event described by ([6T]) . Recall 
that {Jt,t G is an i.i.d. sequence of multivariate Gaussian random vectors, independent 
from all other r.v.s, with the covariance matrix S (|12p . Thus, {J[, . . . , J'j^) is a zero-mean 
multivariate Gaussian vector with = '^f=i{^—Pj)Pj and EJj'Jj = — ^k=jPk+i-jPki i < j- 
In particular it has a continuous positive density everywhere on M^. Namely, assume that 
{Jl, Ji+i, ■ ■ ■ , J'ji) has a continuous positive density everywhere on M^+^~*; this assumption 
holds for i = K because px > 0. Then, ( Jj'_i, ■ ■ ■ , J'x) has a continuous density everywhere 
on Since 

K-l 



J'i-l — Jt+K+i-l,K + Jt+2K+i~l-j,j, 



j=i-l 



jt+K+i-i,K is independent of {Jt+K+j,j = i, ■ ■ ■ , K} and ( J^', . . . , J^) is a deterministic 
function of {Jt+K+j,j = i, ■ ■ ■ , K}. Clearly then F[£ \ {Qt, Lt) = a;] > for every x. 

Second, as in the preceding, by continuity and strict positivity of the density of At and 
there exists a > such that for every set C C ^ 

inf ¥[{Qt+2K,Lt+2K) G C|(Qt,Lt) = x\> au{C), 
Xf^A 

and the requirement (j58p holds. Thus {{Qt, Lt),t £ Z+} is indeed a Harris chain which admits 
a unique stationary distribution. This completes the proof. □ 
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6 Proof of Theorem [2] 

This section is devoted to proving our second main result, Theorem [2j The approach is based 
on the results of Section [4.41 for the limiting Markov chain {Tt, t G Z+} in steady state. The 
proof utilizes the following preparatory lemma. The operators "<" and ">" are interpreted 
element- wise. 



Lemma 11. Let 

P 
I 0^ 



where I is the [K — 1) x [K — 1) identity matrix and is a [K — \)- dimensional vector of 
zeros. Then for t > K — 1 and k > 

-Vt+k - PBk < Yt+k - {Yt)+ < Vt+k, 
where Bk = {k, {k - 1)+ , . . . , {k - K + 1)+) and 

(t t-i t-K+i \ 

\U E N'---' E N • 
i=t-K+l i=t~K+l i=t~K+l / 

Remark 1. Note that is an irreducible, aperiodic stochastic matrix since ||p|| = 1, px > 
and there exist relatively prime i and j such that piPj > (see Section 12. ip . Therefore, 
r'^ — > {ip'^ , . . . , ifP^) as /c — > CO for some unique probability vector ip. 

Proof. The proof is by induction over k. First, we claim that the statement holds for A; = 0: 

-Vt - pBo <Yt- {Yt)+ < Vt, 

or in the scalar form 

- E \yi\<Yt-j-iYt-jr< E 1^*1' 

i=t-K+l i=t-K+l 

where j = 0,1, . . . , K — 1. The upper bound is trivial due to the nonnegativity of \Vi\ for 
all i; the same holds for the lower bound when Yt-j > 0. The case Yt-j < is covered by 
Lemma [6]^i) since it implies Yt^j > Vt-j. Now, assume that the statement holds for some k 
and note that 



(t t t-1 t-K+2 \ 

E E E N'---' E N ■ 
i=t-K+l i=t~K+l i=t~K+l i=t-K+l / 

Consider the upper bound first. The preceding two relationships, Lemma[6]Ji) and the inductive 
assumption yield 

Yt+k+i < (i't+fc)+r + (|i4+fc+i|,o,...,o) 

< {YtV r'^+' + Vt+kr + {\Vt+k+i\,o, . . . , 0) 
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where {x — f5)~^ < is also used. As far as the lower bound is concerned, the same arguments 
and (x — P)^ > x^ — P result in 

Yt+k+i > (Yt+k)^ r - i\Vt+k+i\ +p,o,...,o) 

> (Yt)^ r'^+i - Vt+kT - PBkT - {\Vt+k+i I + /3, 0, . . . , 0) 

>{Yt)+ r'^+i - Vt+k+i - PBk+i . □ 

We conclude this section with the proof of Theorem [2j 

Proof of Theorem [3 Proposition [3l Lemma [10] and Theorem W2\ where in the theorem each 
is identified with {Tt,t G Z}, 7r„ = vr^, and TZp^ = TZp^ yield 

(62) ¥.^,^e{YuZt) <<x, 

for every 6 < 9* /fi. On the other hand, taking expectation (with respect to vr*) of both sides 
of ([15]) implies 

(63) E^,<^g{Yt,Zt) =oo 
for every 9 > 

Next, the definition (03]) of renders p Yt = log ^e{Yt, Zt) - a - Zf. This equality, 
()62p . (I63p . the normal distribution of Zt and Proposition [8] of the appendix result in 

(64) E^. exp{6'p ■ Yt} <oo 
for every 9 < 9* / fi while 

(65) E^. exp{6'p -Yt} = oo 

for every 9 > 9* /iJ,. Given (j64p and (|65p . in order to complete the proof of the theorem it is 
sufficient to prove for every 9 > 

(66) E^,exp{9\fi-^Yt-p-Yt\} 

or equivalently \fi~^Yt—p-Yt\ £ Moo assuming the stationarity of {Yt, t S Z}. Informally, ([66]) 
implies that the stationary r.v.s fi~it and p ■ Yt have the same exponential decay rate. 

The rest of the proof is devoted to establishing ([66]) . Given that ^~^Yt = YlkPkYt-, by 
Proposition [7] of the appendix it suffices to show that \Yt — Yt-k\ G -Moo for every k = 
1,. . . ,K — 1 and stationary {Yj, t G Z}. Consider an arbitrary such k and note that Lemma [TT] 
renders, for j >1 and t > K — 1, 

-Vt+j - PB, < Yt+j - {Yt)+r^ < Vt+j. 
Rewriting the preceding relationship in a scalar form renders 

t+j K-l t+j 

- Yl \n-jP<Yt+j-Y{r^Ui,iytt,< Yl i^^i' 

i=t-K+l i=0 i=t~K+l 

t+j-k K-l t+j~k 

- E \Vi\-{j-k)+P<Yt+,.k-Y.^T')^+^^k+iYtt,< I^^l' 

i=t-K+l 1=0 i=t-K+l 
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and, hence, 



K-l t+j 

(67) \Yt+j - Yt+,_k\ < Yl - ir'h+i,k+i\Ytti + 2 Yl 1^*1 + 2(j + K + 1)/?. 

i=0 i=t-K+l 

In view of Remark[Tl the speed of convergence of F'^ in k is exponential [12, p. 211], i.e., there 
exist constants C and 7 < 1 such that 

sup |(P).+i,i-(r^'W+il <C7^'- 

0<i<K~l 

Then, ([67|) and the preceding inequahty yield 

K-l t+j 

(68) \Yt+,-Yt+j_k\<Cj^Y^t-i + '^ E \n + '^U + K + l)p. 

1=0 i=t-K+l 

Now, observe that the last two terms on the right-hand side of the preceding inequality are 
elements of A^oo due to ([30|) . ([3T]) . and Proposition [71 In addition, from Yf = p ■ Y t — 
'^j^2 Pi^t-i+i (Lemma El^i) ) , (fM]) . Lemma [6^ii) and Proposition [71 it follows that Yt E A^g' 
for some sufficiently small 9' > 0. By stationarity of {Yt,t € Z+} this applies to every term 
in the first sum on the right-hand side of (IGSp . It then follows that \Yt — Yt-k\ G Me" with 
9" = j~^9' /(CK). Since j is arbitrary, by taking it sufficiently large we establish \Yt — S 
A^oo- This concludes the proof of (j66p and the proof of the theorem. □ 

7 Proof of Theorem [3] 

Proposition [H the second part of Lemma [TOl and Theorem [121 from the Appendix imply the 
statement of the theorem. 



8 Proof of Corollary [T] 



First, we note that for a; > 0, as n — > 00, 



(69) 



in probability. Let {Tn,i,i > 1} be interarrival times in the nth system, with r„^i being the 
time of the first arrival after time t = 0. The limit is based on the following: (i) {A^^t > ^} = 
{Si=i "^ra,* — ^} foi' i ^ 0, /c > 1; (ii) for n large enough Markov's inequality yields for e > 



Tn,i <x/^/n 



i=2 



< 



Y - l/An) < -2e/{fiV^) 



■1=2 



and, similarly. 



Tn,i > x/y/n 

i=2 
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as n — > oo; and (iii) the arrival processes are in stationarity and, thus, r„^i has the equihbrium 
distribution and does not impact ([Ml) . 

Second, from the Distributional Little's Law [21] it follows that Q" equals in distribution 
to the number of arrivals in a renewal process during the time interval of length VF" (recall 
that {Af,t S M} is in stationarity), i.e., = ^ovi/" ™ distribution. Then for every x > 0, 
the event {W^ < x} implies {Q^ < Aq^} and, therefore, 

p.AV^w^<x]<f^\q^<ai,^^ 



The distribution of Q is continuous everywhere on (0, oo) as seen from the presence of At+i in 
the expression for Qt+i in (fT^ . Letting n ^ oo in the preceding inequality and applying ([69]) 
yields 

limsupP^,jV^VF" < x] < P^,[Q < fix]. 
Similarly, for every x > 0, the event {W^ > x} implies {Q" > Aq^}, leading to 



and 



The preceding establishes P,r„[-ynl^" < x 
assertion then follows. 



liminfP^„[VraVF'' <x\> P^JQ < /ix]. 

VtiO ^ P^'A as n ^ oo for every x > 0. The 



9 Conclusions 

We analyzed a stationary multi-server queue in the Halfin-Whitt (QED) regime when the 
service times have a lattice-valued distribution with a finite support. Prior analyses of such 
systems in steady-state assumed either exponential or deterministic service times. We described 
the steady-state distribution of the appropriately scaled queue length in terms of the steady- 
state distribution of a continuous-state Markov chain. One can estimate the steady-state 
distribution of this chain either numerically or by simulations. Finally, we have established 
that the large deviations rate of the queue length in steady state is given by 6** = 2/3/(c^ + c^), 
where /? is the extra capacity parameter of the model and Cq , Cg are the coefficients of variation 
of interarrival and service times, respectively. We conjecture that the expression for Q* remains 
valid for a broad class of service time distributions. 
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A Appendix A: Moment generating functions 

Here we list some basic properties of moment generating functions. While these properties are 
well known, we include the proofs for completeness. 

Proposition 7. Any affine combination of (not necessarily independent) nonnegative elements 
ofM oo is an element o/yVioQ. 

Proof. Given two sequences {X",n > 1}, {X2,n > 1} G A^oo of nonnegative r.v.s, and reals 
a, ai, 02 and ^ > 0, the Cauchy-Schwarz inequality implies 

(70) M,V,xr+a,xj(^) < e"^Mx^{2e) Mxj(20). 

The definition of A^oo and nonnegativity of X", j = 1, 2, render limsup„_^oo Mx"{x) < oo, for 
all X, positive or negative. It then follows that the limsup of the product on the right-hand 
side of (fTOl) is finite. The proof for the general case is obtained by induction. □ 

Proposition 8. Suppose {X"-,n > 1} G Mg for some 6 > and {¥'"■, n > 1} G A^oo- Then 
{X" + y", n > 1} G Me' for every 9' < 9. 

Proof Applying Holder's inequality E[XY] < (E[XP])Vp(E[y'?])i/'? with parameters p = 9/9' 
and q = 9/{9 — 9'), defined from 1/q = 1 — 1/p, we obtain 

Ee^'(^"+^") < (Ee^^")''^' (Ee^^"/(^-^')) . 
The statement follows. □ 



B Appendix B: Lyapunov functions 

The following definition plays a key role in the proofs of our main results. 

Definition 1. (Geometric Lyapunov function) Let E = {H^, t G Z+} be a discrete-time Markov 
chain defined on a state space X , equipped with a a-algebra T . A function $ : — > M_|_ is 
defined to be a geometric Lyapunov function for 3 with a geometric drift size < d < 1 and 
exception set TZ <Z X if for every x £ X \ TZ 

E[$(Hi)|Ho = x] < (l-5)$(x). 

(Quadratic Lyapunov function) Under the same setting as above, a function ^ : X is 
defined to be a quadratic Lyapunov function for H with exception set TZ C X and parameters 
6>0,Q<jp<ooif for every x £ X \ Tl 

E[^'2(Hi)|Ho = x]- ^2(2;) < -S'^ix) + -0. 

Informally, the following result shows that if a sequence of Markov chains admits the same 
geometric Lyapunov function that is uniformly bounded in expectation in the exception region, 
then this function is uniformly bounded in expectation in general. Our definition of a geometric 
Lyapunov function as well as the following result is fairly standard [17,33]. 
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Theorem 12. Let {H",n > 1} be a sequence of discrete-time Markov chains with Xn and 7r„ 
being the state space and a stationary distribution ofrP , respectively. Suppose for every n > 1 
function $ : UXn — > 1^+ is a, geometric Lyapunov function for rJ'- with drift 6 and exception 
set TZnC Xn- If 

(71) ^ limsupE^„ G ^n}] < oo 

n— >oo 

then 



limsupE,,J$(Hl^)] <C7^A 

n—*oo 

Remark 2. Note that the uniqueness of a stationary distribution 7r„ is not assumed. The 
theorem holds for every sequence of stationary distributions. 

Remark 3. Our treatment of the geometric Lyapunov function is unconventional. Typicahy 
it is assumed that in the exception region the jumps <I>(H") — $(Hq) are deterministically 
bounded, e.g., see [33]. The intuition behind our result is as fohows. The expected vahie of 
the Lyapunov function is uniformly bounded (in n) since (i) when the chain is in the exception 
region $ is bounded by assumption (in the next time step), and (ii) when the chain is outside 
of the exception region there is a downward uniform drift decreasing the expected value of 

Proof. The proof is similar to the approach taken in [17], and it is based on the Monotone Con- 
vergence Theorem. Assumption (j7T]) implies the existence of uq such that E,r„ [^(^i )l{^o ^ ^n}] < 
oo for all n > hq. Fix an arbitrary such n, introduce the following two conditional expectations 



G\x) = E [$(H^) A 6 I H[f 



x\ 



i^(x)^E[cI>(S^)l{H^G7^„}|S^ = x] 

and let G{x) = G°^{x) for notational simplicity. Then, by the Lyapunov nature of the 
difference of G{x) and ^{x) for x £ Xn can be bounded as 



G(x) - ^{x) < 



-6^{x), xeXn\nn, 

i?(x)-$(x), xeTZn, 



the second case being in fact the equality. Due to the nonnegativity of H{-) and $(•), the two 
cases in the preceding inequality can be combined into 

(72) G{x)-^{x)<-5^{x) + H{x), 

for all X € X^, recall that < (5 < 1 by Definition [H Furthermore, the preceding inequality, 
G^{x) < b (by definition) and the nonnegativity of H{-) yield 

(73) G\x) -^{x) Ab< H{x), 

X G Xn, the validity of the inequality can be verified by considering separately the cases 
$(x) < 6 and $(x) > b. Then, ([711) implies 

(74) IE.„[G^(H^) - HE^o) A fo] < IE.Ji^(H^)] < oo, 
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where the strict inequahty is due to the choice of n > no- 

Now, the Monotone Convergence Theorem renders {G^{x) — A 6} — > {G{x) — $(x)} as 
6 — > oo for every x £ Xn- Using the Fatou's lemma, apphcable due to ([7H) (see also [13, p. 44]), 
we obtain 



hm {g^(HS)-cI>(H^)a6| 



(75) 



>limsupE^„ G''(H^) - <1>(H^) A 6 



0, 



where the last equality follows from the stationary nature of the distribution TTn. 
Finally, ([72]) and ([75]) result in 

-5E^„$(S^^)+E^„F(^^)>0, 

and the conclusion of the theorem follows since this inequality holds for every n > uq. 



□ 



Theorem 13. Let {H",n > 1} be a sequence of discrete-time Markov chains with Xn and Tin 
being the state space and a stationary distribution ofE^, respectively. Suppose for every n > 1 
function ^ : UA'„ — > M satisfies 

(76) E [^\rJt)l{S^, 7^„} - ^^^(H^) | H^] < -5*(H^) + 
for some (5>0, 0<V'<oo and TZn C Xn- If 

(77) Cn ^ limsupE^„ [^\E^)1{E'^ G 7^„}] < oo 

n— >oo 

and 

(78) Co ^ limsupE,„ [-^{E^^)1{^{E^^) < 0}] < oo 

n— ♦oo 

then 

limsupE^„^'(H7) < {Cn + Co + ^)/<5. 

n— >oo 

Remark 4. A non-standard part of our definition of the quadratic Lyapunov function is allowing 
^ to be negative. Our second result in this section shows that if a sequence of Markov chains 
admits the same quadratic Lyapunov function that is uniformly bounded in expectation in the 
exception region, then the (linear part of this) function is uniformly bounded away from +00. 

Proof. The proofs of Theorems [12] and [13] are similar. Assumptions ()77p and (I78p imply the 
existence of no such that E^,J^'2(H?^)1{H(J G 7^„} - ^'(H[})1{^'(H[}) < 0}] < 00 for all n > tiq. 
Fix an arbitrary such n, introduce the following two conditional expectations 

G*(x) ^E[f2(H^) A6|H[J = x] , 
F(x)4E[vI/2(H^)l{H«G7^„}|H^^ = x] 

and let G{x) = G°^{x) for notational simplicity. Then, by (|76p the difference of G{x) and 
^^(x) for X £ Xn can be bounded as 



(79) 



G{x) - ^2(x) < -5^{x) + ip + H{x). 
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Furthermore, the preceding inequaUty, G^{x) < b (by definition) and the nonnegativity of H{- 
yield 



(80) 



G\x) - ^^{x) Ab< -5'^{x)l{^{x) < 0} + V + H{x) 



X £ Xn, the validity of the inequality can be verified by considering separately the cases 
^"^{x) < b and ^"^{x) > b. Then, ([HOD implies 

(81) E^JG'iE^) - ^E^) A 6] < 5E^„ [-^{E^)l{^{E]i) < 0}] + ^ + E.J/7(H^0] < oo, 

where the strict inequality is due to the choice of n > uq. 

Now, the Monotone Convergence Theorem renders {G^{x) — ^^(x) A 6} — > {G{x) — ^^(x)} 
as 6 — > oo for every x G Xn- Using the Fatou's lemma, applicable due to (fSTIl . we obtain 

[G(H^) - ^^(H^)] = [hm {g\E^,) - ^^(H^) a b] 



(82) 



> limsupE7r„ 

6— >oo 



0, 



where the last equality follows from the stationary nature of the distribution vrn 
Finally, ^ and ([82]) result in 



-5E^„^(^^)+V' + E^„i7(S^)>0, 
and the conclusion of the theorem follows since this inequality holds for every n> uq. 



□ 
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